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ELECTRONIC STILL CAMERA FOR 
CAPTURING AND CATEGORIZING IMAGES 

FIELD OF THE INVENTION 

This invention pertains to the field of electronic imagmg ^ 
systems, and in particular to a digital electronic stUl caniera 
of the type that is used with a host computcx. 

BACKGROUND OF THE INVENTION 

As understood in the prior arc a distal electronic still ^° 
camera is a device which uses an electronic sensor to capture 
an image; signal processing to represent the captured signal 
numezically; and some storage device to preserve the 
numedcal image data. B is further known for a digital 
ele(^nic stili camera to use a removable storage device, 
sudi as an integrated circuit memory card, to store images. 
For instance, U.S. Pat, No. 5,016.107 describes an electronic 
still camera utilizing image compression and providing 
digital storage in a removable memory card having a static ^ 
random access memory. In this camera, the integrated cir- 
cuits in the removable memory card store image data and a 
directory locating the data. 

Coordination between a digital camera and a conqniter is 
generally known in the prior art FIG. 1 shows a known 25 
electronic stiU photography system useful fcs^ inputting 
images to a conqmter. The system includes an electronic 
camera 1 with an electronic sensing section la. a digital 
processing section 16, a rnemory card slot 2, and a remov- 
M= able memcry card 3; and a host coizq)uter 4 with a built-in 30 

hi memory cardreader 5, aprinter 6a, a display 6&, akeyt>oard 

a ^ data entry device 7 and a disk drive S. Images are captured 

Yl by the sensing section la in the camera L manipulated in the 

-Jl porocessing section Ifr, stared on the memory card 3. and 

111 transfened firom the card 3 to the host coxiq>uter 4. The 35 

software used to control the sensing and processing sections 
l_ la and 11? in the camera is located in firmware memory Ic 

s H in the camera 1. The ^plication software used to control the 

m playback operations of the host conq>utcr is supplied, at least 

in part by the camera manufacturer. For instance, the 4^ 
manufacturer may provide a special disk or memory card 
yj that comes with the camera. The implication software is 

7^ transferred to the computer hard dnve 8, and then down- 

^ loaded to a coii:q)uter random access memory (RAM) 

memory 9a, where the program is used by a central pro- 45 
oessing unit (CPU) 9b. 

Digital cameras, such as the Kodak Digital Science 
DC40™ camera sold by P/istman Kodak Company, allow 
almost a hundred images to be stored. Because the images 
are stored as sequentially numbered images, it can be so 
difficult and time oonsmning to locate a group of inuges of 
interest firom all of the images stored in the camera. In a 
typical usage, an insurance ac^uster may take a number of 
^otos in processing a number of different claims during one 
day*s operations. It would be desirable to be able to identify 55 
the images of each group, for exan^le by claim number or 
client name. It may be further desirable to allow this 
information, along with die date and time or a con^any 
logo, to be optionally included with the image data. This 
ensures that any prints made from the camera can be easily ^ 
identified. Such processing of the c^tured images is today 
performed in a host computer, such as the host con^)uter 4 

in no. 1. 

The Kodak Professional Digital Camera System (model 
DCS-lOO) included a digital camera tetiiered by cable to a 65 
separate digital storage unit (DSU). The DSU, ginn'iflr to the 
conq)uter 4 of FIG. 1, contained a hard drive for storing 
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images, a small image display, and a keypad for ma!iq)ulat- 
ing the images. For images that had already been captured 
by the camera, the system included a **tag*' feature that 
aUowed a user to flag selected images for later display or for 
5 uploading from the DSU to another con^uter. Suppose that 
a user wanted to tag a couple of already-captured images for 
later viewing or uploading. The first of the images would be 
brought up on the display and a 'tag** button on the keypad 
would be pressed, and so on with the other images that are 
to be tagged. Then if the user presses a *1ind tags" key on the 
keypad, the first of the tagged images is displayed (and/or 
uploaded). With a second press of the **find tags" key, the 
second tagged image is displayed (and/or uploaded), and so 
on. 

Another embodiment of this camera, the Kodak Hawkeye 
n camera, also allowed the user to type in a name for any one 
image after the image was taken, and to add a "note" 
text-string to the image file. Both cameras allowed a simple 
division of already-captured images into "tagged" and ''not- 
tagged" images and required a pattern of keystrokes subse- 

20 quent to capture for every image of interest Ih particular, the 
tagging feature functioned more as a post-capture data 
gatekeeper than as a useful tool for image handling. Any- 
thing more complex in the way of data <7ganization requires, 
as shown in FIG. 1, the use of a special application program 

25 in &e host computer 4 to organize and sort the image data. 
Consequently, it would be desirable to have an electronic 
still system that could handle image content more efficiently 
in the field than is presently the case. 

3P SUMMARY OF THE INVENTION 

The present invention is directed to overcoming one or 
mrare of the problems set forth above. Briefly summarized, 
according to one aspect of the present invention, an elec- 
tronic camera captures images representing a variety of 

35 subjects and categorizes the image according to subject 
matter, The camera conqxises an image sensor for the 
images, a converter stage for converting the images into 
digital image data, and a memory for stmng a plurality of 
categories providing dassificatioa of the images by subject 

40 A processor in the camera has the capability of assigning the 
plurality of categories to the images c^tured by the camera, 
with each category providing subject classification of one or 
more images. A user then interacts with a user control on the 
camera in order to select one or more of the categories for 

45 the images, and an output image signal is then generated 
including the digital image data corresponding to the images 
and the one or naore categories selected by the user control. 

The advantage of the invention is that the known provi- 
sion of a simple post-c^ture "tag" is enlarged into useful 

so pre-capture categories that can effectively manage images 
according to variable subject content According to this 
invention, a digital camera includes a display-based **tag" 
icon/feature which the user can set to an appropriate cat- 
egory before taking a group of pictures. The category names 

55 can be defaults, or can be names and optional text (ie., 
account number) and/or graj^cs overlays (i.e., company 
logo) entered via a host con[q>uter and uploaded to flie 
camera before the pictures are taken. When the user selects 
a particular category, the category name is stored along with 

50 the image data in the image file, and any text and graphics 
logo, as appropriate, are overlaid onto the image. When 
downloading the images to a host oon^uter. ttie user can 
select a category and download only the images which have 
a particular category name, or the images can be stored in 

65 folders labeled with each category name. 

These and other aspects, objects, features and advantages 
of the present invention will be more clearly understood and 



qypreciated from a review of the following detailed descr^ 
tion of the prefecred embodimciits and upended daims, and 
by reference to the acconipanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 5 

FIG.l is a diagram of a known electronic imaging system 
incorporating a digital camera for inputting images to a host 
computer* 

FIG. 2 is a block diagram of an electronic camera con- 
figured according to tbt invention to process and categorize 
images. 

FIG. 3 is a diagram of the status display panel and the user 
control switches used in tiie camera shown in HG. 2. 

FKt. 4 is a process diagram for categorizing Images 12 
according to default parameters stored in the camcxa shown 
innG.2. 

FIG. 5 is a process diagram for categorizing images 
according to externally generated parameters supplied to the 
camera shown in FIG. 2, 20 

FIG. 6 is an example of categories that are customized 
from a host computet; 

FIG. 7 is an,exanq)le of a file format resulting fix>m 
customized categories. 25 

FIG. 8 is an example of an image display with customized 
category information overlaid into flie image. 

FIG. 9 is an additional-diagram of the status display panel 
and the user control switches set up for activating an overlay 
feature. 30 

FIG. 10 is an example of an image file management 
structure using categories. 

DETAILED DESCRIPnON OF THE 

INVENTION 35 

Because electronic still cameras employing electronic 
sensors are well known, the present description will be 
directed in particular to elements forming part of, or coop- 
erating more directly with, apparatus in accordance with the 40 
present invention. Elements not specifically shown or 
described herein may be selected from those known in the 
art Certain aspects of the embodiments to be described are 
provided in software. Given the system description as 
described in the following materials* all such software 45 
implementation is conventional and within the ordinary skill 
in such arts. 

FIG. 2 shows an electronic still camera enable of cat- 
egorizing images as taught by the invention. The electronic 
still camera is divided generally into an input section A and 50 
a conqiression and recording sec^on B. The input section A 
includes an exposure section 10 for directing image light 
firom a subject (not shown) toward an image sensor 12. A 
flash unit 11 may be used to illuminate the subject Although 
not shown, the exposure section 10 includes conventional ss 
optics for directing the image light through a di^hragm, 
which regulates the optical c^>erture, and a shutter, which 
regulates exposure time. The sensor 12, which includes a 
two-dimensional array of photosites corresponding to pic- 
ture elements of the image, is a conventional diarge-coupled 60 
device (CCD) using, e.g., either well-known interline trans- 
fer or finame transfer techniques. The senses' 12 is exposed to 
image lig^ht to capture a particular image; accordingly, 
analog image charge information corresponding to the par* 
ticular image is generated in respective photosites. The 65 
charge information is applied to an output diode 14, which 
converts the charge information to analog image signals 
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cotresponding to respective picture elemcDts of the particu- 
lar image captured. 

Hie analog image signals are applied to an A/D converter 
16, which generates digital image data from the analog input 

5 signals for each picture element The digital image data is 
appUed to an image buffer 18 for storing one or more 
images, albeit shown in ELG. 2 as a random access memory 
(RAM) with storage cap&dty for a plurality of still images. 
A programmed control processor 20 genexally controls tiie 

IQ input section A of the camera by initiating and controlling 
exposure (by operation of the diaphragm and shutter (not 
shown) in tiie cjcposm section 10), by controlling the flash 
unit 11, by generating the horizontal and vertical clocks 
needed for driving the sensor 12 and for clocking image 
infonnation Ihere&om, and by enabling the A/D converter 
16 in conjunction with the image buffer 18 for each signal 
segment relating to a picture element Exposure control 
would typically be effected by using ambient ligjit infanna- 
tlon £rom a photocell 19, and a shutter button 21 allows the 

20 user to initiate a capture cycle. The processor 20 also 
receives date and time infonnation from a date/time gen- 
erator 20a. 

Once a certain amount of digital image data has accumu- 
lated in the image buffer 18, the stored data is applied to a 

25 programmed digital signal processor 22, whidi controls the 
throughput processing rate for the compression and record- 
ing section B of the camera. The algorithms and other 
operating code used by the processor 22 are stared in an 
algoriftm memory 28. The digital signal processor 22 com- 

30 presses each still image stored in tiie image buffer 18 
according to any one of a number of known image com- 
pression algorithms, such as tiie weD-known JPEG (Joint 
Photographic Experts Group) discrete cosine 
transformation-based compression algoriflim. The processor 

35 22 applies the conq)ression algorithm from the memory 28 
to tiie digital image data, and sends the con^ressed data to 
a removable storage device via a signal port 26. However, 
while conqiression is shown in the camera of FIG. 2, 
con^ression is not a necessary feature, and uncompressed 

40 data could be stored instead in the removable storage device. 
In this exanq)le, the signal port 26 is a card interface and 
the removable storage device is a memory card 24. While a 
memory card 24 is shown in this system as the storage 
device, other devices may be used, sudi as.a.floppy_disk_ 

45 ^ magnetic medium^ ^a small hard drive, or o pgcal stora ge fin 
t he latter c ases, suitable conventional'reading/writing appa- 
ratus would" be provided in the camera, e,g., magnetic or 
optical read/write head..etc.). A r^resentatlve memory card 
. is a card adapted to the PCMCIA card interface standard, 

50 sudi as described in the PC Card Standard, Release 2.0, 
published by The Personal Computer Memory Card Inter- 
national Association, Sunnyvale, Calif.. September 1991. 
The memory card 24 accordingly contains solid state 
memory 24a, such as Flash EPROM memory, which the 

55 card uses to store image data fUes. 

According to this invention, the digital camera includes a 
categorization feature which enables a user to establish an 
approittiate category, providing classification of the images 
by subject, before taking a group of pictures. The category 

60 infonnation can be default code symbols (A,B,C, etc.), or 
can be externally-generated category information, such as 
names and optional text (i.e., account numbers) and/or 
graphics overlays (ie., company logos), which is altered via 
a host conq>uter and uploaded to the camera througli the 
65 signal port 26 b^ore the pictures are taken or via cable 
connection. After die user selects a particular category, the 
image is captured and the category information is stored in 
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the removable storage device along wish the image data in 
the image file, and any text and graphics logo, as 
q>propriate, are overlaid onto the image. When downloading 
the images to a host computer, the user can select a particular 
category and download only the images whidi have a 5 
paiticoUr category identifier, or the images can all be 
downloaded and stored in file folders labeled with each 
category name. 

Consequently, the memory card 24 contains additional 
memory to store header files 246 containing category infor- 10 
mation helpM in providing classification of the images by 
subject matter. Such category information may include 
default tag codes, sudi as single alphabetic identifiers A, B, 
C, D, ^c, or alphanumeric names that can be associated 
witti specific images according to subject matter. The header 15 
files 2Ab can also contain strings of text ^at identify 
particular images and sq>arate graphics images that signify 
or o&erwise identify subject matter. The header files 2Ab can 
also contain instructions to oveday all or part of the category 
information into the image data files 24a, or, alternatively, 20 
the digital signal processor 22 can access an algorithm in the 
algoritiun memory 28 which acconqilishes the overlay, and 
then stores all or part of the category information with the 
image data. It is a further feature of this invention that the 
externally gennated category information can be supplied to 25 
the digital camera through the signal port 26. Such exter- 
nally generated categ<xy information can be stcs-ed in the 
Card Information Structure (dS) of the PCMCIA Format 
(as described in the aforementioned Release 2.0), in the 
header data file 24b. or in a portion of the memory space of 30 
the memory 24a used to store the image data. 

The camera also contains a memory section 31, including 
firmware memay 32a with operating code for the camCTa, 
as well as RAM instruction memory 326 connected to 
receive code from the memory card 24. When the memory 35 
card 24 is inserted into the camera, the processor 20 uses tiie 
firmware algorithms in the memory 32a to determine if the 
memory card 24 contains externally generated files which 
can be used by the camera. If not, the firmware algorithms 
supplied with the camera in the memory 32a are used by the 40 
programmable processor 20. In particular, the default cat- 
egory parameters are stored in die firmware memory 32a 
and accessed by the processor 20. If the card does contain 
appropriate externally generated category information, 
however, these are downloaded from the header file section 45 
24b of the card 24 to the RAM instruction memory 32b and 
used by the programmable processor 20 in place of some 
portion of the firmware algorithms supplied with the camera 
from the firmware memory 32a. In this way the camera can 
execute customized category definitions which provide so 
higher quality or more complex categorization of pictures. 

User control is provided by a status display 30 connected 
to the control processor 20 for displaying information useful 
in operation of the camera, and by a set of user control 
switdies 29. The set of user control switches 29 are also 35 
connected to the processor 20 for entering, highlighting, and 
selecting information displayed on the status display 30. In 
accordance with invention, the status display 30 is a liquid 
crystal display (LCD) having a panel configuration 50 such 
as shown in FIG. 3, which includes a **tag" icon 52a, and an 60 
alphanumeric segmented section 52b, (The panel configu- 
ration includes other typical icons, such as a battery level 
icon 52c. a fiash mode icon S2d, a sdf-timer icon 52^, and 
an image dd^ icon S2f.) The user control switches 29 
include a toggle switch 54 and a select button 56. The toggle 65 
switch 54 is used to toggile to a setting once an icon has been 
activated by the select button 56. For exan^le, if the flash 
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mode icon S2d is highlighted and showing that it is the 
cuirently active control, pressing the select button would 
activate the tag icon 52a and malce it the cunently active 
controL 

5 While not important to this invention, other infcxmation 
displayed on the status display 30 mig;ht Include typical 
photographic data, such as shutter speedL aperture, exposure 
bias, color balance (auto, tungsten, fluorescent, daylight), 
higji/low resolution, low light exposure modes (aperture 

10 prefened, Gutter prefened). and so on. Moreover, other 
information unique to this type of camera may be displayed. 
For instance, the memory card 24 would ordinarily include 
a directory signifying the beginning and ending of each 
stored image. This would show on the disfday 30 as either 
(or both) the number of images stored or the number of 
image spaces remaining, or estimated to be remaining. 

If externally generated category information is present in 
the header file 24b on the card 24, it can also be identified 
on the status display 30. For instance, the externally gener- 

20 Ated category information, such as names, text strings, and 
gr^hics images can be identified and displayed if the status 
display 30 has the appropriate display capability. 
Alternatively, the toggle switch 54 can be used to cycle 
through alphanumeric names that are provided firom the host 

25 oonq>uter and displayed on the segmented section 526. 
Selecting any one name then automatically accesses any text 
string or graphics image that might be associated with the 
name in the instruction mcmoxy 326, and stores such strings 
or graphics image with the digital image data. The camera 

30 may also have the additional feature of overlaying a text 
string, or date and/or time from the date/time generator 20a, 
into the image. Whether or not fiie date/time cr text string is 
pveriaid in die images of any particular category can be 
controlled by overlay control information for each category 

35 present in the header file 246. Alternately, this can be done 
£rom additional icons in the panel configuration 50 and from 
the user control switches 29, as shown in FIG. 9. Date, time, 
name, and text are separately activated by the toggle switch 
54, and "on" (overlay active) or "ofT icons are activated by 

40 the select switdi 56. It is assumed that an uploaded graces 
image would always overiay into the image, bat if diis is not 
always desirable, then a separate graphics icon may be 
provided for overlay control. 

The process for categorizing images according to default 

45 parameters is shown in FIG. 4, and the process for catego- 
rizing images according to customized, externally generated 
parameters is shown in FIG. 5. Referring first to FIG. 4, 
when the camera is first turned on, the 'tag** icon 52a will 
be shown only in outline fcam (stq> 60). The inner part of the 

50 "tag- icon 52a will fill to indicate when the user has 
positively selected the tag feature by activation of the user 
control switches 29. In the default mode, there are a prede- 
termined plurality of possible categories, for example, five 
alphabetic categ<xics A^,CU)JE and NONE (or OFF). With 

55 the tag icon 52a activated, the user will select categories 
AJB,C JDJBJ^ONE (repeat sequence A3, ctc;) by pressing 
the toggle switch 54 (step 61). Each press of the switch 54 
causes a different tag code to be displayed on tiie alphanu- 
meric segment 526. 

60 After the tag is selected, the user can activate other icons 
by use of the select button 56. Then, when the shutter button 
21 is pressed, the selected categoxy (tag) is associated widi 
the digital image data (steps 62, 63). Then the steps 62, 63 
are repeated for any additional images in the same category. 

65 If a new category is desired, the process reverts to step 61. 
When all the images arc captured, the user connects the 
camera (by cable) or the memory card 24 to a host computer 
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(step 64), such as the host computer 4 illustrated in FIG. 1. 
Using software supplied by the camera manufacturer, the 
user opens a camera ^iplication and chooses the desired 
category (st^ 65). Then the images from appr o p riate cat- 
egories stored in the camera, or the memory card 24» are 5 
downloaded to proper file folders according to the category 
data stored with Uie digital image data in each file (step 66). 

Tlie user may also customize the tags using the host 
computer. As shown in tiie process diagram of FIG. 5, a user 
inputs categoiy information, such as category names, and 
related text or gr^hics images, from the host computer (step 
70). The user then downloads the category information to 
the camera (step 71). This may be done through a tethered 
connection to the camera, or by writing appropriate files into 
the memory card 24. The user turns on the camera (step 72), 
and selects an appropriate category (step 73). At this stage, 
the user can also decide to activate the overlay c^afaility f or 
date, time, text, and graphics images. The picture is taken 
(step 74), and the category information is c^tionally overlaid 
into the image (step 7§. The digital image data is then stored 
in the memory card 24 together with category information, 20 
either separately or as overlaid into the image data (st^ 76). 
The remaining steps are substantially the same as in FIG. 4. 

FIGS. 6, 7, and 8 show examples of categories customized 
from a host computer, following on the previously men- 
tioned claims adjuster exan^le, and the resulting file format 25 
and image display. As shown in FIG. 6, the categories (tags) 
are given names, optional text strings, and graphics. The 
category inf<smation also includes overlay control informa- 
tion indicating whether or not the text string, date, and time 
should be overlaid into the imaged In this example, tiie user, 30 
a free-lance claims adjuster, has created four different cat- 
egories (HIU and H122) for different insurance claims from 
a first insurance company, one (F123) for a claim from a 
second insurance company, and one (KIDS) for personal 
images. Hie user also indicates whether the text string 35 
should be overlaid into the image, and whether the camera 
should overlay the date and/or time in the image. This 
category information, including names, text, and gr^hics, is 
then downloaded to the host computer from the memory 
card 24. A ^ical technique for such downloading is 40 
described in U.S. Ser. No. 08/219,608, entided **Electronic 
Imaging System Using a Removable Software-Enhanced 
Storage Device", which is to issue as U.S. Fat No. 5,477, 
2§4 on Dec 19, 1995.* 

When programmed by the host or rauemory card 24, the 45 
number of tag categories that can be selected in the camera, 
and the four-letter name of each category, is as set by the 
user via the host computer. The user selects the appropriate 
category before taking a sequence of images. The tag names 
and text are then included in the image files, as shown in 50 
FTG. 7. In this example, the user selected Tag name HUl 
and took images #1-2. The user then selected Tag name 
KIDS and took images 5-S. Finally, the user selected tag 
name F123 and took image #6. As the images arc captured 
and processed, the appropriate overlay information for the 55 
tag chosen is used. For the category '^123", the tag indicates 
that the image should include a graphics overlay, the text 
••Qaim #123", and the date/time, as shown in FIG. 8. In a 
further embodiment shown in FIG. 10, images are stored on 
the removable memory card 3 within a file 80 containing a 60 
group of files corresponding to each category. For example, 
file 82 contains images #1 and #2 having tag name "Hill**, 
file 84 contains images #3, #4 and #5 having tag name 
•*KIDS", and file 86 contains image #6 having tag name 
'F123**. 65 

After the images from the camera are stored on the 
memory card 24, the card is inserted into the coniputer 
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memoiy card reader 5 (see FIG. 1). In applications where the 
memory card may contain categoiy i£f ormation which can 
be used by the compater, the conq)uter uses the software 
supplied with the camera to check if the memory card 

5 contains such infonnation. If the card does contain appro- 
priate category infonnation, this information is downloaded 
from the card to the RAM instniction memory 9a and used 
by the CPU 9b in combination with the software algorithms 
&om the hard drive 8. This allows a quick and convenient 

10 way of categorizing the images accessed by the concenter* 
witiiout requiring further intervention from the host com- 
puter 

According to the invention shown in FIG. 2, the images 
are transferxed from the camera to the computer via the 

15 removable memory, rather than a cable interface. Therefore, 
the camera does not have to be in the same location as the 
conc^uter. Hiis makes it possible to view the images from 
the camera in many different locations, on many different 
computers, as long as the computer has the ability to both 

20 accept the removable memory and correctly process the 
image data. Since the removable memory can be used to 
store code for processing the image data in ttio computer, 
this code can include the processing algorithms needed to 
download the stored images according to tiie stored catego- 

25 ties. The advantage of storing the processing algorithms on 
the removable monory is diat it elitninates the need for a 
separate means of supplying the code, such as the floppy 
disk. Supplying the algorithms along with the images on the 
removable memory, such as a PCMCIA card, makes it 

30 possible for any computer capable of reading tiie image data 
from die card to also download and utilize the algorithms 
needed to process die image data in order to create one or 
more iiles of categorized images. 

The invention has been described with reference to a 

35 preferred embodiment However, it will be a^eciated diat 
variations and modifications can be effected by a person of 
ordinary skill in the art without departing from the scope of 
the invention. For example, the image files shown in FIG. 7 
could be stored in many different types of c^tical, magnetic, 

40 or solid-state digital memory. The categoiy customization 
information shown in FIG. 6 could be transferred from the 
computer 3 to the camera 1 via a cable connec^on instead of 
via a removable memoiy card, or the camera 1 could include 
means for entering category oistomization information. 

PARTS UST 

1 ELECTRONIC CAMERA 

lA ELECTRONIC SENSING SECHON 
IB DIGITAL PROCESSING SECnON 
50 IC FIRMWARE MEMORY 

2 MEMORY CARD SLOT 

3 REMOVABLE MEMORY CARD 

4 COMPUTER 

5 MEMORY CARD READER 
55 6a PRINTER 

eb DISPLAY 

7 KEYBOARD 

8 HARD DRIVE 

9 A COMPUTER RAM MEMORY 
60 9B CPU 

10 EXPOSURE SECnON 

11 FLASH UNIT 

12 IMAGE SENSOR 
14 OUTPUT DIODE 

65 16 AA^ CON VERTE R 
18 IMAGE BUFFER 
20 CONTROL PROCESSOR 



